Hebbian crosstalk and input segregation.
نویسندگان
چکیده
Hebbian synapses respond to input/output correlations, and thus to input statistical structure. However, recent evidence suggests that strength adjustments are not completely connection-specific, and this "crosstalk" could distort, or even prevent, learning processes. Crosstalk would then be a form of adjustment mistake, analogous to mistakes in polynucleotide copying. The mutation rate must be extremely low for successful evolution (which is a type of learning process), and similarly neural learning might require minimal crosstalk. We analyze aspects of the effect of crosstalk in Hebbian learning from pairwise input correlations, using the classical Oja model. In previous work we showed that crosstalk leads to learning of the principal eigenvector of EC (the input covariance matrix pre-multiplied by an error matrix that describes the crosstalk pattern), and found that, with positive input correlations, increasing crosstalk smoothly degrades performance. However, the Oja model requires negative input correlations to account for biological ocular segregation. Although this assumption is biologically somewhat implausible, it captures features that are seen in more complex models. Here, we analyze how crosstalk would affect such segregation. We show that, for statistically unbiased inputs, crosstalk induces a bifurcation from segregating to non-segregating outcomes at a critical value which depends on correlations. We also investigate the behavior in the vicinity of this critical state and for weakly biased inputs. Our results show that crosstalk can induce a bifurcation under special conditions even in the simplest Hebbian models, and that even the low levels of crosstalk observed in the brain could prevent normal development. However, during learning pairwise input statistics are more complex, and crosstalk-induced bifurcations may not occur in the Oja model. Such bifurcations would be analogous to "error catastrophes" in genetic models, and we argue that they are usually absent for simple linear Hebbian learning because such learning is only driven by pairwise correlations.
منابع مشابه
Hebbian Crosstalk Prevents Nonlinear Unsupervised Learning
Learning is thought to occur by localized, activity-induced changes in the strength of synaptic connections between neurons. Recent work has shown that induction of change at one connection can affect changes at others ("crosstalk"). We studied the role of such crosstalk in nonlinear Hebbian learning using a neural network implementation of independent components analysis. We find that there is...
متن کاملHebbian errors in learning: an analysis using the Oja model.
BACKGROUND Recent work on long term potentiation in brain slices shows that Hebb's rule is not completely synapse-specific, probably due to intersynapse diffusion of calcium or other factors. We previously suggested that such errors in Hebbian learning might be analogous to mutations in evolution. METHODS AND FINDINGS We examine this proposal quantitatively, extending the classical Oja unsupe...
متن کاملHebbian Inspecificity in the Oja Model
Recent work on Long Term Potentiation in brain slices shows that Hebb's rule is not completely synapse-specific, probably due to intersynapse diffusion of calcium or other factors. We extend the classical Oja unsupervised model of learning by a single linear neuron to include Hebbian inspecificity, by introducing an error matrix E, which expresses possible crosstalk between updating at differen...
متن کاملHebbian On-line Learning for Spike-processing Neural Networks
We present a Hebbian learning rule for spike-processing neural networks. Spike-processing networks are mainly used for figure-ground segregation and object recognition. They have been introduced according to experimental results and theoretical studies which suggest that temporal correlation of activity might be used by the brain as a code for feature binding and figure-ground segregation. The ...
متن کاملSegregation of ON and OFF retinogeniculate connectivity directed by patterned spontaneous activity.
In many parts of the developing nervous system, the early patterns of connectivity are refined by processes that require neuronal activity. These processes are thought to involve Hebbian mechanisms that lead to strengthening and maintenance of inputs that display correlated pre- and postsynaptic activity and elimination of inputs that fire asynchronously. Here we investigated the role of patter...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
- Journal of theoretical biology
دوره 337 شماره
صفحات -
تاریخ انتشار 2013